Known unknowns, unknown unknowns and information flow: new concepts in decentralized control

Discovering Unknown Unknowns of Predictive Models

Predictive models are widely used in domains ranging from judiciary and healthcare to autonomous driving. As we increasingly rely on these models for high-stakes decisions, identifying and characterizing their unexpected failures in the real world is critical. We categorize errors of a predictive model as: known unknowns and unknown unknowns [3]. Known unknowns are those data points for which t...

“Known Knowns, Known Unknowns, & Unknown Unknowns”: Computational Science challenges for analysis of multi-dimensional DNA matrices in Evolutionary & Population Genomics

The advent of so-called NextGen DNA sequencing methods has massively increased the rate at which DNA sequence information can be generated, and the volume and complexity of the data matrices that apply to biological questions, including molecular and organismal evolution and population biology. One such approach is the analysis of complete mitochondrial DNA (mtDNA) genomes from multiple species...

Known knowns, known unknowns, and unknown unknowns: can systems medicine provide a new approach to sepsis?

Knowledge Discovery Through Spoken Dialog

People can acquire knowledge not only from media such as books, but also through interactions with other people. Automated dialog agents, however, typically limit their learning from labeled data, and programming. This thesis describes an approach that enables such agents to actively acquire new knowledge through spoken dialog interaction. To acquire knowledge in different situations, we propos...

Known knowns, known unknowns, unknown unknowns and the propagation of scientific enquiry.

In February 2002, Donald Rumsfeld, the then US Secretary of State for Defence, stated at a Defence Department briefing: ‘There are known knowns. There are things we know that we know. There are known unknowns. That is to say, there are things that we now know we don’t know. But there are also unknown unknowns. There are things we do not know we don’t know.’ As a result, he was almost universall...